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Abstract 

In this paper we show that in systems where the probability distribution of the 
the overlap is non trivial in the infinity volume limit, the property of ultrametricity 
can be proved in general starting from two very simple and natural assumptions: 
each replica is equivalent to the others (replica equivalence or stochastic stabil- 
ity) and all the mutual information about a pair of equilibrium configurations is 
encoded in their mutual distance or overlap (separability or overlap equivalence). 

1 Introduction 

Since its introduction in 1975 |1[ the Sherrington-Kirkpatrick (SK) model for spin glasses 
has been one of the major challenges for the physicists interested in complex systems. 

Although it is a mean-field model the exact solution is still not completely certain. 
Nonetheless it is known [3] that in the low-temperature phase the replica symmetry is 
spontaneously broken and this makes the solution highly non trivial. In other words it 
can be rigorously proved that it is not possible that the connected correlation function 
of the spins at different points goes to zero when the total number of spins N goes to 
infinity; consequently the probability distribution of the overlap q (defined below) cannot 
be a single delta function as happens in usual model (e.g. ferromagnetic model). The 
existence of fluctuating intensive quantities (like q) implies that it is not possible that 
only one equilibrium state is present in the thermodynamic limit. As usual extensive 
quantities do fluctuate when more than one equilibrium state is present and consequently 
we could say, with some abuse of language (see 0] for a more precise discussion) that in 
the SK model, for large values of N more that one equilibrium state is present. 

The presence of many equilibrium states implies that any analytic solution of the 
model should tell us something on the nature of these states, on their relative rela- 
tions and on the probability at equilibrium of finding the system in one of these states. 
Of course this information should be of probabilistic nature given the presence of the 
quenched disorder in the system. Using the replica formalism an Ansatz was proposed 
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almost twenty years ago || which makes some hypothesis on the nature of the states, 
the most notable being ultrametricity. Roughly speaking ultrametricity implies that the 
distance among the different states is such that they can be put in a taxonomic or ge- 
nealogical tree such that the distance among two states is consistent with their position 
on the tree. 

This hierarchical Ansatz seems every day more reliable and, although the physical 
origin of ultrametricity was not fully evident, it is widely believed that it provides the 
correct solution of the SK model. The ultrametric solution has passed many numerical 
tests and it is in agreement with all the known analytical results [|, 0]. It is quite possible, 
and in agreement with the numerical simulations, that the ultrametric organization of the 



equilibrium configurations is also present in finite dimensional spin glasses 0, |9|, [UJ |Tl[] . 

It is certainly very interesting to find which are the physical assumptions at the 
basis of the hierarchical Ansatz for two reasons: it would be easier to understand if the 
assumptions make sense also in the finite dimensional case and it could be easier to prove 
them of to extract their consequences. 

A considerable progress has been done in recent years when it was realized that one 
of the main hypothesis at the basis of the hierarchical Ansatz was stochastic stability: 
many compulsory arguments can be given for the validity of stochastic stability and the 
correctness of this hypothesis can be directly tested in experiments measuring the fluc- 
tuations and the response to a perturbation of the appropriate quantities. In the replica 
language stochastic stability is equivalent to the usual assumption of replica equivalence 
(i.e. each replica is equivalent to the others). 

The other pillar of the hierarchical Ansatz turned out to be ultrametricity. Indeed 
it can be shown that if we assume stochastic stability and ultrametricity, the whole 
hierarchical Ansatz can be reconstructed ||. 

The aim of this note is to show that there is a simpler property which is equivalent 
to ultrametricity. This property can be called separability, in the replica language, or 
overlap equivalence: it states that all the mutual information about a pair of equilibrium 
configurations is encoded in their mutual distance or overlap. In other words according 
to the principle of overlap equivalence any possible definition of overlaps should not give 
information additional to that of the usual overlap. It is not clear if there are strong 
compulsory reasons for assuming overlap equivalence, however, the results presented here 
show that the hierarchical Ansatz is certainly the simplest one that we may think for a 
stochastically stable system with many equilibrium states: any other possible proposal 
should include the presence of at least two inequivalent definitions of distance. 

These two assumptions, stochastic stability and overlap equivalence, are quite general 
and can be applied to many other systems beyond the SK model. A direct test or an 
analytic proof of the validity of both properties would have direct implications on the 
validity of the ultrametric solution. Moreover as we have already remarked the results 
that we are going to present in this paper is interesting because they show the root 
of ultrametricity: ultrametricity is the unique possibility we have if we stay within the 
simple framework where stochastic stability and separability hold. 

It should be clear that the whole discussion applies to systems in which the overlap 
fluctuates also when the volume is very large and consequently replica symmetry is 
broken. For systems in which the overlap does not fluctuates and replica symmetry 
is exact we have nothing to say (ultrametricity is satisfied, but in a trivial way). It 
should also be clear that the arguments presented here cannot be used to argue if replica 
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symmetry breaking happens or not in a particular system. We do not discuss here the 



criticism that have been done to the replica approach by [T2|, [L3| (who cast some doubts 
on the viability of replica symmetry breaking in finite dimensional systems): the reader 
may find a quite long discussion in J4j. 

In the second section we will recall the replica formalism, in the third section we will 
present our assumptions. Next in the forth section we will present our main results on 
the relation among overlap equivalence and ultrametricity. Finally we will present our 
conclusions. Some of the arguments needed to show that overlap equivalence implies 
separability are presented in Appendix I and a part of the tedious algebra we have to do 
to reach the results is confined in appendix II. 



2 The replica formalism 

In this paper we make use of the replica formalism (we address the reader to Refs. 0, 
0, [14], [15| for an introduction on the issue). Let for simplicity restrict the discussion to 
systems with quenched random disorder in the Hamiltonian. A similar discussion can 
be done for system without quenched disorder (like structural glasses) if we substitute 
the average over the quenched disorder with the average over the size of the system. 

We consider a system with N spins characterized by an Hamiltonian Hj(a) (where J 
represents the quenched disorder). We define Pj(q) to be the probability distribution of 
finding two equilibrium configurations a and r at the same inverse temperature j3 with 
overlap q, the overlap q being defined as 

JV i=l,N 

Let us assume that, in the large N limit, the function Pj(q) does not becomes a delta 
function (otherwise we have nothing interesting to say) and therefore the function Pj(q) 
has a non trivial shape also for large N. When this happens, we are interested to find out 
the probability distribution of the function Pj{q) in the limit where iV goes to infinity. 
For a given value of N different choices of J may produce different functions Pj{q) and 
we can introduce the functional Vn(P) as the probability distribution of Pj(q) at fixed 
iV (we assume that the J have a given probability distribution). Eventually we would 
like to know 

Poo(P) = lira P N (P) . (2) 

We are also interested to control the behavior of the probability distribution of the 
mutual overlaps among three or more equilibrium configurations (e.g. the probability 

12 23 31 

Pj ' ' (912,923,931) which will be properly defined later). 

The origin of our interest in the probability distribution of the overlap is due to 
the fact that they control many others physical properties of the systems: e.g. in some 
models one finds ]l(J that the magnetic susceptibility is given by x — — (9)) where 
{q) is the average over J of the equilibrium expectation value of q. 

In the replica formalism the behavior of the these probability distributions is encoded 
by an n x n symmetric matrix Q in the limit of n — > (taken after the analytical 
continuation of n from integer to real values). The limiting matrix depends on all the 
matrices with any value of n and so the general solution has an infinite number of 
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parameters and the analytical continuation of the matrix Q is, in general, dependent 
on an extremely high number of parameters. This is quite natural as far as the matrix 
Q encodes the properties of the functional which controls the probability distribution 
of finding for a random J a set of probability distributions for the overlaps (i.e. Pj(q), 

P 12,23,31/ \ \ 

J (?12,?23,?3l), •••)• 

In the hierarchical Ansatz the n replicas are divided into many groups of equal sizes, 
such that, if the replica indices a and b belong to the same group, then Q ab has a 
higher value than whether a and b are in different groups. The groups are then divided 
in subgroups and so on for an infinite number of times. This kind of solution can be 
summarized in an infinite set of parameters (the size of the group and the value of 
the overlap at each level). In the limit n — > these parameters can be conveniently 
represented by a function Pii(q) defined for q e [0, 1], where Pn(q) is the probability of 
finding in the matrix Q an element of value q. To every ultrametric matrix Q corresponds 
one and only one probability distribution function Pn(q). 

In the paramagnetic phase all the elements of Q are equal and the function Pr(?) is 
a delta function. In the spin glass phase the elements Q a b take different values and the 
Pfj(g) acquires a finite width. 

The relation of this function with the probability distribution function of the overlap 

is 

P R (q) = P{q) = lim PM , (3) 

N^oo 

where the bar denotes the average over J at fixed N. The equality of the two functions 
Pn(q) and P(q) is one of the many relations among probability distribution functions of 
the overlaps and the matrix Q. 

More complicated probability distribution functions (pdf) can be defined, consid- 
ering the joint probability of more than one overlap. For example a crucial role is 
played by the joint pdf of 3 real replicas -P 12 ' 23 ' 31 (<?i2, 523, 53i), defined as the J-average 
of Pj 2 ' 23 ' 31 (gi2, 523, <?3i) where a 1 , a 2 and a 3 are three equilibrium configurations and 

Qafi = l E <^ , (4) 
iV i=l,N 

with the indices a and (3 running from 1 to 3. 

If ultrametricity holds, this probability distribution has the following property 

P 12 ' 23 ' 31 (gi2,g 2 3,g 3 i) = o , (5) 

as soon as the ultrametricity relations 

512 > min(523,53i) , 

523 > min(53i,5i 2 ) , (6) 
5 31 > min(5i2,523) , 

are not satisfied. The UM property can be easier understood by a geometrical picture. 
Given three configurations, that is three points in the configurational space, UM implies 
that they can be the vertices of two kind of triangles only: equilateral or isosceles, with 
the two equal edges larger than the third one. The other kind of isosceles triangles, 
together with the scalene triangles, can not be obtained with any tern of equilibrium 
configurations, if these configurations are organized in an UM fashion. 
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This property, which is satisfied in the hierarchical Ansatz, has rather strong conse- 
quences. 

Firstly, as far as probabilities cannot be negative, the previous relations implies that 

1 2 23 3 1 

also for any J (with probability one) we have that Pj ' ' (gi2, 923, 931) = as soon as the 
relations in Eq. @ are not satisfied. This result has the consequence that any equilibrium 
configuration can be assigned (for fixed J) to a leave of a tree constructed in such a way 
that the overlap among two equilibrium configuration is related to the distance of the two 
configurations on the tree. Ultrametricity implies for example that, if two equilibrium 
configurations 1 and 2 are at overlap q±2 > q, any equilibrium configuration 3 such that 
<7i3 > q satisfies also the relation q 2i > q. Ultrametricity is very interesting because it 
implies that many pdf of more than three overlaps are zero in a wide region and reduces 
the whole problem to the construction of the statistical properties of the aforementioned 
tree. 

Moreover, if stochastic stability is valid, the ultrametricity completely determines the 
pi2,23,3i gj ven p(g). One can show that M 

pl2, 2 3,31 (g; gfj qll) = A{q) 5{g _ ql) 5{q _ qll) + ql) e{q _ ql) 5{ql _ qll) + 

B(q', q") 9(q' - q") 5{q" - q) + B(q", q) 6{q" - q) 5{q - q') , (7) 

where 

A(q) = \p{q) f q dq'P(q>) , (8) 
2 Jo 

and 

B{q,q')= l -P{q)P{q') . (9) 

In other words stochastic stability and ultrametricity allow us to obtain all the pdf of 
the overlap starting from the knowledge of the function P(q). 



3 The assumptions 

It is clear that it is extremely difficult to arrive to some general conclusions on these 
probability distributions without doing extra assumptions. We now show that two rather 
simple assumptions: replica equivalence (or equivalently stochastic stability) and sepa- 
rability are giving very strong constraints. 

Let us firstly consider replica equivalence as formulated in replica formalism. 

As we have already stated the properties of the probability distribution of the overlaps 
can be obtained in terms of the matrix Q a i,. Even in the low-temperature phase, when 
the matrix elements Q a b are not constant, we may expect no physical difference between 
the replicas (which have been introduced as a mathematical trick). Replica equivalence 
states that the observable which involve only one replica are replica symmetric, i.e. the 
assume the same value. For example replica equivalence implies that we must have that 

E /«?«*) ( 10 ) 
b 

does not depend on a. 

Replica equivalence is equivalent to the stochastic stability property introduced by 
Guerra and Aizenman and Contucci J/J which is valid under general conditions, i.e. 
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if we introduce an arbitrary small random long range Hamiltonian (see for a more 
careful discussion). 

Eq.fllOD implies that each line (column) of the matrix Q is a permutation of the 
other lines (columns). Moreover it has interesting consequences: with some algebra the 
following equalities can be proven 

^ 12 ' 13 (<?i2, 9i 3 ) = \p{qi2)P(qn) + \p(qvi)&{qn - 9i 3 ) , 

P 12 ' 34 (gi2, qu) = ^(912)^(934) + lP{qi2)S{q 12 ~ qu) • (H) 

The proof of these equations can be done by recalling some relations among the 
matrix and the probability functions 

7-.12J3/ \ i- ^2a,b,c=l,nQa,bQa,c 

P ' (912, 9is) = km 



n^o n(n — l)(n — 2) ' 

ol2,34/ \ r ^2a,b,c,d=l,nQa,bQd,c , . 

^ ' 912,934 ) = hm— — " — , 12 

n[n — l)(n — 2)(n — 3) 

where the primed sum is done over all different replica indices. Let us denote 

9 (fc) = - E i b (13) 

b=l,n 

The sum does not depend on a as consequence of replica equivalence. It is also evident 
that 

E = q (kl) q (k2) (14) 

a,b=l,n 

If we now look to the consequences of the previous equation and we use the relations 
in Eq.(0) both for a = b and a 7^ b, we obtain the two relations in Eq.flTTD. 

Identical relations have been proven by Guerra |§, using stochastic stability. We 
can very safely assume that they must be valid in any scheme of replica symmetry 
breaking. Eq . (|TTD determine all the joint pdf of 2 real replicas in terms of the P{q). The 
consequences of stochastic stability have been lengthy discussed in [|T5|, [T7|, [T?|. In the 
nutshell stochastic stability implies that the system is a generic random system and it 
does not have any special properties: its properties are smooth functions of any external 
random perturbation. 

The second assumption we made is the separability (also know as non- degeneracy) 
of the matrix Q ||15|| , which correspond to the following statement. Let us consider all 
the matrices which can be generated from the matrix Q in a permutational covariant 
fashion. Some example are 

Qab 1 QacQcb i Q acQ adQ cdQ cbQ db ■ (15) 

c c,d 

Separability states that, if we take two pair of indices (ab and cd), we have that 

Qab = Qcd M ab = M cd (16) 



where M is a generic matrix of the set generated by the rules shown in Eq.(15). In other 
words pairs of indices which have different properties have different values of the overlap. 
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It means that we can classify a pair of replicas in terms of their mutual overlap [18| and 
that no finer classification of their mutual properties is possible. 

The physical meaning of separability can be understood if we introduce another 
concept, the overlap equivalence. Let us consider an arbitrary local observable 0;(cr). 
Simple examples of such an observable are 

Oi = Ai^kO'k, 
k 

Oi = ^2 Bi-kj-i&kVi, (17) 
k,i 

Oi = a i a kJi,k 
k 

where A and B are appropriate functions (e.g. they decrease sufficiently fast at infinity). 
Many more complex choices of the local observable O can be constructed, for example 
those involving more than two spins. 

For any choice of the operator O we could define a generalized overlap |0J : 



?o = ^E 0, t (a)O t (r) . (18) 

JV i=l,N 

In the hierarchical Ansatz it turns out |2(J that for any reasonable choice of the 
observable O, qo is a function of q. In other words when we change the two equilibrium 
configurations and the couplings J the values of q and qo fluctuates also for very large 
N, while the value of qo restricted on those pairs of configurations with a fixed value of 
q does not fluctuate when N goes to infinity (that is a scattered plot of q and qo should 
collapse on a curve in the limit of large N). In other words overlap equivalence implies 
that in the case where replica symmetry is broken and all overlaps fluctuate in the usual 
thermodynamical ensemble, these fluctuations disappear in the fixed q ensemble. 

In other words overlap equivalence states that for a system composed by two replicas 
the overlap is a good, complete order parameter in the same way as the magnetization 
is for ferromagnetic systems. If we stay in the usual thermodynamic ensemble, there 
are many quantities that fluctuates also at large distances, however if we consider the 
restricted ensemble where the order parameter takes a given value, all fluctuations at 
large distance disappear and the connected correlation functions go to zero at infinity. 
This happens only if the order parameter has been chosen in such a way to carry enough 
information: in a ferromagnetic Heisenberg model the order parameter must be the three 
component vector of the magnetization, one or two components of the magnetization 
would be not enough to fully characterize the state of the system in case of a spontaneous 
magnetization. 

A direct check of overlap equivalence can be done in usual numerical simulations and 
it would be very interesting to see the results. 

This property is called overlap equivalence because it states that all possible defi- 
nitions of the overlap are equivalent and there is an unique correspondence among the 
values of the different overlaps. 

It is clear that the overlap equivalence is a very strong simplification. In general we 
could have that the mutual relations among two equilibrium configurations are charac- 
terized by a large, possibly infinite set of independent overlaps and therefore their mutual 
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relations are characterized by a large (or infinite) set of parameters. The property of 
overlap equivalence implies a much simpler situation, where only one parameter (the 
overlap q) characterizes the mutual relations among two equilibrium configurations. 

We can argue that separability is the way to code overlap equivalence in the replica 
formalism. Both properties state that once the overlap among two objects is fixed, all 
the mutual relations among the two objects are also fixed. The difference among these 
two statements is that in the case of replica equivalence the two objects are equilibrium 
configurations while in the case of separability the two objects are replicas. The iden- 
tification of separability with overlap equivalence is quite natural because the structure 
of the matrix Q in replica space mirrors the structure of the mutual overlaps of equilib- 
rium configurations. In appendix I we present some more detailed considerations which 
points toward the correctness of the identification of these two properties, however a 
more general and formal proof of this statement would be welcome. 

It is interesting to note that in the simplest model leading to ultrametricity, i.e. 
a branching random process in the infinite dimensional space the condition of overlap 



equivalence is satisfied [21]. Indeed if we consider a random vector Xq- 111 cL finite di- 
mensional space (of dimension N) the quantities x a convey different information when 
a changes from 1 to N and can be used as different measures of the distance. On the 
other end, when N goes to infinity at fixed x 2 = J2 a =i,N x a> thanks to the rotational 
invariance, we have that for each a, {x 2 a ) = ^ — * 0. Then if we introduce generalized 
distances parameterized by A (where < A < 1) and defined as 

x \ = 1 E *l , (19) 

a=l,\N 

it is easy to check that with probability 1 (if the probability distribution is rotational 
invariant) in the limit iV — > oo 

x\ = x\ = x 2 . (20) 

Therefore in this simply model overlap equivalence is automatically satisfied. 

Let us consider what happens in the usual hierarchical Ansatz. In this case, when 
replica symmetry is broken, there is a subgroup of the group of permutations that com- 
mutes with the matrix Q. Let us consider the orbits in the space of pairs of indices. 
It can be checked that the values of the elements of the matrix Q and of any matrix 
derived using the rules in Eq. flToT) are constant of the orbits and that different values 
of q do correspond in general to different orbits. Moreover it can be checked that both 
separability and overlap equivalence hold in this case. 

Maybe the simplest non-trivial example of a non-ultrametric system is given by the 
union of separately ultrametric system with a non-trivial distribution of the overlaps . 
It is easy to check that q = Xq± + (1 — X)q2 does not satisfy the ultrametric condition also 
if qi and q2 do satisfy it. However it is clear that in this example q\ and qi are general- 
ized overlaps which are not function of q. Both ultrametricity and overlaps equivalence 
disappear at the same time []. 

The separability condition is extremely powerful in determining the expectation val- 
ues of higher order moments of the probability distribution. Let us study a simple 

^dn the last example both ultrametricity and stochastic stability are violated. There are no known 
examples of stochastically stable states which are not ultrametric. As far as we know, it is still possible 
that stochastic stability implies ultrametricity. 
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example and let us consider two matrices M and R constructed with the rules in Eq. 
(|T5|). It is evident that we can write 

£ Q k ab M ab = Y, [ dq5(q - Q ab )Q k ab M ab = f dqP(q)M(q)q k , 
b b J J 

£ Q k ab Rab = E / d <?% - Qab)Q k ab Rab [ dqP(q)R(q)q k , (21) 
b b J J 

where we have defined 

P(q) = J2 S (l-Qah) • (22) 

b 

Indeed separability implies that the matrix elements M ab and R ab are constant in the 
region where Q ab = q and their value is denoted M(q) and R(q) respectively. In the 
same way we have that: 

J2Q k abMabRab = JdqP(q)M(q)R(q)q k . (23) 



Therefore separability implies that quantities like those in Eq . (P3|) can be computed from 
the knowledge of those in Eq. (|2"T|) . 

If we introduce the functions Pm(q), Pr(q) an d Pmr{q) such that 

Y,Qa b M ab = [ dqP M (q)q k , 
b J 

Y,QlbRab= fdqP R (q)q k , (24) 
b J 

Y J Q k a h MabRab= f dqP MR (q)q k , 
b J 

the previous equations implies that 

Pu(q) = P(q)M(q), P R (q) = P(q)R(q), P MR (q) = P(q)M(q)R(q). (25) 
The last equation can also be written as 

P MRig) = M£MiL . (26) 

If we apply the previous formula to the case where M and R have the form 

M ab = T,QacQc 2 b , (27) 

c 

Ra b = Y,QalQct , (28) 

c 

and we consider all the possible values of the fc's, we find (after separating the contribu- 
tions where some of the indices are equal) the rather surprising formula 

3 pl2,13,32,24,41 (g) ^ fe fe ft) = _ _ g^plWlfo ^ fe) + 

+2 p^ • (29) 
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Similar results can be obtained for other probability distributions with more overlap. 
Eq.(|29|) is particular interesting because integrating over q it implies that 



3 p i3,32,24,4i ((7i) fe ?3) qA) = 1 5{qi _ qA)5{q2 _ ga) [P ( gi )p( g2 ) + S ( qi - q 2 )P{q 2 )\ + 

J P(q) 

The previous equation is remarkable not only because it give the full expression of 
the probability with four overlap in terms of the probability with three overlaps but also 
because it puts hard constraints on the possible values of the function p 12 ' 23 ' 31 (g ; q X) g 2 ). 
Indeed the l.h.s. of Eq.([30|) is by definition invariant under cyclic permutation of the g's, 
while the r.h.s. of the same equation is not invariant for a generic choice of the function 

pl2,23,31 

What is the form of the generic function p 12 > 23 > 31 that satisfy Eq. ([$(])? We will argue 
in the next section that it must be ultrametric. 



4 Results 

Our problem is now that of finding the most general matrix Q (or equivalently the most 
general probability distribution) compatible with the replica equivalence [and then with 



Guerra's relations, Eq.(ll)] and with separability [and then in particular with Eq.(|30])]. 
We will show that the most general matrix is the ultrametric one. 

We consider the case when few values (k = 3, k = 4 or k = 5) are allowed for the 
matrix elements. The generalization to more than 5 values is straightforward and we 
hope that our conclusions will still be valid for a generic P{q) which have a continuous 
distribution of possible values. 

When the overlap (or the matrix elements Q a b) can take only k different values the 
function P(q) is the sum of k delta functions 

^(<z) = > (31) 

i=l 

where the weights pi are, by definition, positive and such that J2iPi — 1, an d the values qi 
are different. Also the joint pdf of 3 overlaps p 12 > 23 > 31 (that hereafter we will call P^ for 
brevity) is the the sum of k 3 delta functions on the points (<&, qj, q{) with i, j, I = 1, . . . , k 
and so we should give the k 3 weights Piji in order to determine P&\ 

We can lower the number of free parameters p^i using some symmetries and the 
Guerra relations. The weight of the tern (qi, qj, qi) must be the same of any permutation 
of it, i.e. P122 = P212 = P22i- Then the number of really independent parameters in 
is k(k + l)(k + 2)/6. More relations between the p^i can be obtained exploiting the 
following equation, which is based essentially on the first Guerra's relation 

J dqPW(q, qi ,q 2 ) = P 12 ' 23 (g 1; q 2 ) = l -P( qi )P(q 2 ) + ^P(<2i)%i - q 2 ) . (32) 

These are k(k+l)/2 relations that lower the degrees of freedom of P^ to (jfc-l)fc(fc+l)/6. 

Then we have to determine the values of these (k — l)k(k + l)/6 parameters which 
are compatible with Eq. 
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4.1 Three overlaps (k = 3) 

To fix the ideas, let us write down some formula? for the easier case (k = 3) where we 
have 27 parameters pijf pm,Pii2,Pii3,Pi2i, ■ ■ ■ , P333- The symmetries imply that 

' Pin = P121 = P211 , 

(33) 

. Pl23 = Pl32 = P213 = P231 = P312 = P321 , 

while the Guerra's relations imply some equalities like 

' EjPuj = \p\ + \pi , 

< vV i ( 34 ) 

1. • • • 

We end with only 4 free parameters (s, 032, 031, 021): 



P321 


= S 




P332 


= Gt32 




P331 


= «31 




P221 


= CJ21 




P322 


= P3P2/2 - a 3 2 


— s 


P311 


= P3P1/2 - a 3 i 


— s 


P211 


= P2P1/2 - a 21 


— s 


P333 


= p 3 (l+p 3 )/2 


— a 31 — a 32 


P222 


= p 2 (l+p 2 )/2 


-P3P2/2 + a 32 - o 2 i + s 


Pill 


= Pl (l+ Pl )/2 


- p 3 Pi/2 - P2P1/2 + a 3i + a 2i + 2s 



(35) 



The way we have ordered the probabilities is meaningful: we call s the weight of the 
scalene triangle (which is forbidden in the ultrametric solution) and we call 032,031,(321 
the weights of the isosceles triangles (which are also forbidden in the UM Ansatz if we 
assume the overlap ordering q± < q 2 < 03). 

If we do not fix any order in the values of the we have to keep in mind that, whether 
we exchange two of the overlap values, the forbidden isosceles triangle changes. For 
example, if q\ < q 2 < q 3 then ultrametricity implies P332 = P331 = p 22 \ = 0, while when 
we reverse the second inequality, i.e. q\ < g 3 < q 2 , we have that p% 22 = p 33 i = p 22 i = 0. 
Then we note that 

s = a 32 = a 31 = a 21 = =>■ UM , (36) 

while the reversed implication is not true, because UM also holds for different parameters 
values, e.g. s = a 3i = a 2 i = and a 32 = £>3£> 2 /2 (that corresponds to the ordering 
qi <q 3 < fe). 

For a generic k we have k(k — l)(k — 2)/6 scalene parameters Si which must be all 
identically zero in order that UM hold ({si = 0} <^=^ UM), while the k(k — l)/2 isosceles 
parameters must be zero or = \piPj, depending on the order of qi and qj. 

We will now use Eq . (|30|) to determine the values of all these parameters. The l.h.s. 
of Eq.(|30D is invariant under cyclic permutations of the four overlaps. This allows us to 
obtain useful relations simply taking two of these equations (the second one with the 
overlaps cycled with respect to the first one) and equating the right hand sides. The 
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number of non-trivial equations we can obtain in this way is large enough to fix all the 
parameters. 

In the particular case of k = 3 we have that all the non-trivial equations are equal 
(this is highly fortuitous) and read 

- 2a 32 a 31 p 2 p x + 2a 32 a 21 p 3 p x - 2a 31 a 21 p 3 p 2 + a 31 p 3 p 2 2 p x + 2a 32 p 3 p 1 s + 
-2a 32 p 2 p x s - 2a 3 ip 2 p x s + p 3 p 2 p\S - p\p 2 p\S + 2p 3 p 2 s 2 + 2p 3 p l s 2 = (37) 

Using the relations that comes from the sixth equation in (|35|) 



^31 = -PaPl ~ S - P311 , (38) 

we can write Eq.(|37|) as 

E Q + 2(a 32 p 3 pi + a 21 p 3 p 2 + p 3 np 2 pi)s + 2(p 3 p 2 + p 3 p x + p 2 pi)s 2 = , (39) 

where in E we put all the terms that survive once we set s = 0. The coefficients of s 
and s 2 are positive defined (thanks to the positiveness of all the probabilities) and Eq in 
non- negative (as we will show in a while). Then Eq.([3^) is equivalent to 

(40) 




«3iP3P2Pi - 2 a 32d 3 ip 2 pi - 2a 31 a 2 ip 3 p 2 + 2a 32 a 2 iP3Pi = 



As a first result we obtain that scalene triangles are completely forbidden. 
Let us now introduce the following symbol 

((x; y, z)) = x — xy — xz + yz = x(l — y) (1 — z) + (1 — x)yz . (41) 

For x,y,z £ [0, 1] we have that ((x; y, z)) > and the equality ((x; y, z)) = only holds 
on 6 of the 12 edges of the cube (those in bold face in Fig. [I]). 
If we introduce the new parameters 

0^ = ^- , (42) 
3 PiPj 

that belong to the range [0, 1] thanks to the positiveness of the probabilities, then the 
second equality in Eq.(^Dj) can be rewritten in a very compact form as 

((4i;«32,4i)) = o . (43) 

This form makes clear that E is non-negative, as we claimed above. 

Eq.pSD is not so stringent as ultrametricity would, but the deviations from UM are 
small. In fact, in the cube 032,^31, cl' 21 G [0, 1] (see Fig. |l|) strict UM only holds on the 
vertices marked by a circle. While Eq. fl4*3|) is satisfied along the bold lines too. 

For example, on the segment a' 32 = a 31 = and < a' 21 < 1 they seem to co-exist 
non-zero probabilities P221 arid p 2 n and it would be a small violation of UM. However 
we know that = a 31 = a' 21 = correspond to the ordering qi < q 2 < q 3 , while 
a' 32 = a' 31 = and a 21 = 1 correspond to q 2 < q% < q 3 . Then we believe that the points 
on the segment between this two UM points corresponds to the case qi = q 2 < q 3 , when 
there is no difference between p 22 i and p 2 n (but we can not still prove it). 

In conclusion, in the case with k = 3 overlaps, we have that the scalene triangle and 
two of the three "wrong" (in the UM sense) isosceles triangles are forbidden. As we will 
see below, the UM violations become smaller and smaller as k is increased. 
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Figure 1: Schematic representation of the properties of the symbol ((x;y,z)), it takes 
non-negatives value in all the unitary cube and it is zero only on the bold edges. 

4.2 Four or more overlaps (k > 4) 

In this section we would like to sketch how the information we need about P^ can be 
systematically derived from Eq . (|30l) . To make this section more readable, the formulae 
relatives to the cases k — 4, 5 will be presented in Appendix II. The method we use to 
obtain the results does not depend on k and so we will be able to generalize our findings 
to whichever P(q) that is the sum of a finite number of delta functions. 

The many equations derivable from Eq.(^) can be divided into three classes: those 
with 2, 3 and 4 different values of the overlaps. These equation are not independent: 
those with 2 (respectively 4) different overlaps can be expressed as the sum (resp. dif- 
ference) of those with 3 overlaps. 

There are many ways of solving the equations. Here we present the simplest one we 
were able to find: we have to consider only the equations with 2 and 3 overlaps, i.e. those 
which respectively correspond to the equalities 

P 12W (ft, ft, ft, ft) - P 12W (ft, ft, ft, ft) = , (44) 

and 

P 12 < 23 < 34 < 41 (ft, ft, ft, ft) - P 12 ' 23 > 34 > 41 ( % ft, ft, ft) = . (45) 

Each one of these equations can be identified giving a pair or a tern of numbers: 

or The l.h.s. of these equations will be called respectively E^' and E^ ,l \ for 

brevity. 

Our demonstration follows two steps: first we show that the equations of the kind of 
Eq.(|4"l"D can be solved only if all the scalene parameters piji (with I different) are zero, 
then we find all the solutions for the simplified set of equations corresponding to Eq . (|45|) . 
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Our demonstration is essentially based on the non-negativity of the E^> expressions and 
on the properties of the double-parenthesis symbol, previously introduced. 

First of all we note (see Appendix II) that when we set to zero all the scalene param- 
eters piji (with I different), every E^' becomes the sum of some double-parenthesis 
symbols, and so it is non-negative. Moreover in some of the expressions all the 

scalene parameters have positive defined coefficients, and then we should set them to 
zero in order to solve the equation, E^'^ = 0. In Appendix II we present a possible way 
of choosing the E^'^ expressions in order to systematically set to zero all the scalene 
parameters. 

Once the scalene parameters have been set to zero, we prefer working with Eq . (|45|) . 
because each equation identified by takes a very simple form: 

((<4;e4,ay) = ° > ( 46 ) 

where we choose the indexes such that q^ < qj <qi- In general, given 3 different overlap 
values, we can easily write down the corresponding equation [of the kind of Eq. (flop], 
which gives, once we set all the scalene parameters to zero, the corresponding double- 
parenthesis symbol [of the kind of Eq. (|46|)] . 

What about the equation with 2 and 4 different overlaps? When we set all the 
scalene parameters to zero, we have that the expressions are the sum of k — 2 of 

these double-parenthesis symbols, those derived from the overlap terns (qi,qj,qh) with 
qh 7^ qi and q^ ^ qj (that is those where the parameter aL appears). On the other hand 
the equations with 4 different overlaps are identically satisfied and they are useless. 

Then we conclude that, in the more general solution, Eq.(f46|) must hold for every 

overlaps tern q^ < qj < q\. What does it imply in terms of the ultrametric properties of 

p(3)? 

For any pair of overlaps qi > qj we have two different isosceles triangles: a "right" 
one (i.e. allowed by UM) with probability pijj and a "wrong" one (i.e. forbidden by UM) 
with probability puj oc a\j. In the solution we have found, almost all the wrong isosceles 
triangles are forbidden. More precisely, for any pair of overlaps q^ > qj, such that there 
is an overlap q^ in between (qi > qh > Qj), we have that a[- = and the wrong isosceles 
triangle is not allowed. That can be easily proved noting that, for any qi > q^> qj, the 
equation ((a^-; a' ih , a' h j)) = forces a[j = 0. 

Small UM violations can appear only when one considers nearest neighbors overlaps 
pairs. In this case both the right and the wrong isosceles triangles are allowed. However, 
for any fixed k, the maximum number of wrong isosceles triangles allowed is [|], while 
the total number of isosceles triangles is proportional to k 2 . So in the limit k — > oo the 
probability of having wrong isosceles triangles tends to zero. 

Moreover, if in the continuum limit the P(q) is dense on a single compact domain, 
the distance between any pair of nearest neighbors overlaps tends to zero for k — > oo 
and then strict UM holds for any finite overlap difference | — qj \ . 

Lastly it should be noted that we have not exploited all the available information 
and maybe even these small UM violations could be ruled out with some more work. 
In fact we believe that the solution with both puj and p^j different from zero, actually 
corresponds to the case = qj and it is not really an UM violation. 

Maybe it should be also possible to find a direct proof of our result directly in the 
continuum limit, without considering the intermediate case in which the number of steps 
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are finite, using maybe the techniques introduced by Ruelle [23], however we have not 
succeeded in this task. 



5 Conclusions 

We have seen that in systems where the function P(q) is non trivial and the overlap 
is a fluctuating quantity, stochastic stability and separability imply ultrametricity. The 
reader should notice that the proofs presented here are likely to be too involved and it 
is quite possible that there is a direct proof of the fact that replica equivalence implies 
ultrametricity. At this end we recall that in a dynamical approach it was show that 
one can identify a dynamical equivalent of separability: i.e. we can assume that in the 
aging regime all the possible overlaps among two configurations at two quite different 
times (ti and £2) are functions of the usual overlap among the two configurations at the 
same times (t\ and t-z). It was possible to prove that this dynamical overlap equivalence 
implies a dynamical form of ultrametricity. 

This result implies that, if we do not give up stochastic stability (which is a general 
property of generic equilibrium systems) violations of ultrametricity may be found only 
in systems for which the separability conditions does not hold and the mutual relations 
among equilibrium configurations is described by two or more overlaps. The probability 
distribution of such a system (if it exists in the framework of equilibrium statistical 
mechanics) would be much more complex of that of the usual ultrametric Ansatz. We 
can thus conclude that the ultrametric solution is the simplest one. 

Our arguments imply that it would be particularly interesting to check the numerical 
validity of overlap equivalence. This task can be done at high precision using present nu- 
merical technology. This could be done just doing numerical simulations in the ensemble 
with fixed overlap and looking to the fluctuations of the other overlaps. 
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Appendix I 

In this appendix we present some arguments in order to show that separability implies 
overlap equivalence. 

To this end let us consider a specific spin glass model 

Hj = J ik°i°k , (47) 

i,k 

where the variables J are Gaussian uncorrelated random variables with zero average and 
variance 

jfk = K ik . (48) 

In short range models is a fast decreasing function of the distance among the two 
points i and k while in the SK model = iV _1 , N being the total number of spins. 
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In this model we can define not only the usual overlap but also a modified overlap 
among two configurations a and r which we denote by r: 



r = E J ik°i T k ■ (49) 

i,k 

In the same way we can define an overlap among two replicas, which we denote by r ab 

r ab = ^J2M^ b k ) • (50) 

i,k 

We notice that by simple integration by part on the Gaussian variables J one can 
prove that 

^=^—r, E , (51) 

with 

ta b =(r ab )Y,^Y,^^M4^ C k) , (52) 

i,k c "■{"■ l ) 

where by the overbar we denote the average over the random quenched variables J. 

A similar computation tells us that the fluctuations of the quantity r at fixed q are 
(neglecting terms which go to zero with the volume) the same as the fluctuations of i a & 
at fixed q a b. On the other end it is evident that 

EE^K^^HE^A • (53) 

c i,k iV c 

Separability states that the last sum takes a fixed value which does not fluctuates if we 
stay in the ensemble of fixed Q a b- 

At this level the relation among separability and overlap equivalence is clear: the first 
is equivalent to the statement that the quantity N^ 1 J2i J2c(< J i°'k cr i cr k) does not fluctuate 
(in the fixed q a t ensemble) when i — k is large, while for overlap equivalence we need the 
same quantities does not fluctuate when the distance among i and k is fixed. 

The two properties seems to be slightly different if the interaction is short range. 
On the contrary if the interaction is long range the two formulations are the same. In 
order to be more precise we can consider a model in which a small long range interaction 
has been added and the same argument as before can be used to prove that overlap 
equivalence implies separability. Moreover the presence of a long range term should not 
affect too much the properties according to the principle of stochastic stability which 
tells us that the system should be stable with respect to a small random perturbation. 

The argument we have presented here tell us that replica equivalence implies separa- 
bility. 



Appendix II 

In this appendix we show some details of the computation we have done in the cases 
k = 4 and k — 5 . In particular we show exactly how to derive the solution for the k = 4 
case, while we simply sketch it in the k — 5 case. 
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The k = 4 case 



In the case k = 4 we have 4 scalene parameters (pA32,PA3i,PA2i,P32i) and 6 isosceles 
parameters (p 4 43 = a 4 3,£>442 = 042,£>44i = 041,77332 = a 3 2,p 3 3i = ^31,^221 = a 2 i). The 
remaining probabilities are functions of these 10 parameters: 



P433 


= P4P3/2 - 


O43 


-£>432 


-P431 


P422 


= P4P2/2 - 


042 


-P432 


-P421 


P411 


= PaPi/2 - 


O4I 


-P431 


-P421 


P322 


= P3P2/2 - 


«32 


-P432 


-P321 


Kill 


= P3P1/2 - 


«31 


-P431 


-P321 


P211 


= P2P1/2 - 


021 


-P421 


-P321 


P444 


= p 4 (l+p 4 )/2 


— 043 - 


- 042 — O41 



(54) 



£>333 = P3(l +P3 -P4)/2 - a 3 2 - 031 + «43 + £>432 + £>431 

P222 = P2(l + P2 - P3 - Pi)/ 2 ~ 021 + CJ42 + 32 + 2p 432 + £>421 + £>321 

Pill = P\ + 4 1 + 031 + 2 1 + 2(^431 + P421 + P32l) 

Let's consider the equation of the kind of Eq.(pE4"D with the two greatest overlaps (g 4 
and 03 in the k = 4 case), 

1 2222/ 

77(4,3) 1 , ^431 , ^432 , P433 , fl 43 / a 41«31 . 042032 043P333 . P444P433 

h, y ' > = -p4p 3 H 1 1 1 1 1 1 

2 Pi P2 P3 Pa \ Pi P2 P3 Pa 

(55) 

Using some of Eqs. (|54] ) and multiplying the previous equation by c = 2pip 2 p3p 4 we end 
with the following equation 

cE^ = cE^ 3) + 

+ [2p 1 p 3 p 4 a 4 3 + PiP2P3(paP3 ~ 2a 43 + PaP2 - 2a 42 + PaPi - 2a 4 i)](p 43 2 + p 4 3i) + 

+ [4p 1 p 3 p 4 ]p 4 32P431 + [2PiPa(P2 + P3)}p1 3 2 + [2P2Pa(Pi + P3)]P431 = ■ ( 56 ) 

In Eq 4 ' 3 ^ there are all the terms that survive from the expression E^^ when we set all 
the scalene parameters to zero. In general all the expressions Eq'^ are non-negative 
defined (see below). 

The coefficients of p 432 and p 43 i in Eq. (|56D are positive defined, thanks to the inequal- 
ities p 4 p 3 > 2a 43 ,p 4 p 2 > 2a 42 ,P4Pi > 2a 4 i, that are direct consequence of Eqs. (|54]) and 
of probabilities positiveness. Then we have that Eq. fl5"6| ) is equivalent to p 432 = P431 = 
and Ej 4 ' 3) = 0. 

To force the two remaining scalene parameters to zero, it is enough to consider 
the equation analogous to Eq.(p5|) with qi and q 2 instead of 03 and g 4 . Once we set 
P432 = P431 = we obtain 

cEW = cE^ ,l) + [2piP3p 4 (a 4 2 + a 32 ) + PiP2Pz{PaP2 ~ 2a 42 + PaPi ~ 2a 4 i)]p 42 i + 
+ [2pip 3 p 4 (a 4 2 + 032) + PiP2Pa(P3P2 ~ 2a 32 + p 3 px - 2a 3 i)]p 3 2i + 

+ [2P3Pa(Pi +P2)](PA2i +P321) 2 = . (57) 

Again we note that all the coefficient are positive defined thanks to Eqs.(p^) and to the 
positiveness of the probabilities. Eq.(|57j) implies p 42 i = P321 = and £j 2 ' lT = 0. 

Then we conclude that the more general solution to Eq.(^) in the case of k = 4 
different overlaps forbids any scalene triangle. 
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In order to obtain this result we have made only one assumption, about the non- 
negativity of E^ 3) and of E^ A \ which we now show to be correct. Using the rescaled 
variables, a' ri - = those expressions read 

= 4 (( a 42; a 43> a 32)) + 4 (Ki; a 4 3; a 3i)) > (58) 

p(2,l) PlP2PA (( , , , xx. P\P2PZ (( , , , xx 

^0 = 4 ((a 4 i;Q42» a 2l)) + 4 (( a 3li a 32 ; a 2l)) • (59) 

Note that eJ 4,3) (resp. eJ 2,1) ) is the sum of the two double-parenthesis symbols containing 
a' 43 (resp. a' 21 ). 

Once we set to zero all the scalene parameters j9 432 = P431 = P421 = P321 = 0, we 
found easier to work with equations of the kind of Eq. (|45|) . For example, considering the 
3 overlaps q\ < q 2 < 93, we have that 

n nl2,23,34,41/ \ t-,12, 23,34,41 / \ P1P2P3 , , / , / u /Pr ,\ 

= P (91,91,92,93) - i 3 (9l,92,93,9l)= 4 (( a 3i; a 32, a 2l)) • (so) 

In general for every 3 given overlaps we end with an equation like Eq.(H3). 



The k = 5 case 

The way to force the scalene parameters to zero should be now clear: it exploit the 
coefficient positiveness in the equations with 2 different overlaps. Maybe it is still not 
so clear if there is a systematic way to set all those parameters to zero, without getting 
lost in the many E^' expressions. 

We found such a systematic way and we will illustrate it in the case with k = 5 
different overlaps. Let's always consider first the equation with the two greatest overlaps 
(gs and g4 in this particular case). It implies 

£(5,4) =Q ^ ^ = ps42 = = q (61) 

Note that all the scalene probabilities forced to be zero contain both g 5 and 04. 

Then let's substitute the just found solution (p 543 = p 5i2 = P541 = 0) into all the 
other equations and let's go forward in the same way 

£(5,3) =Q ^ p532 =ps3i = ^ (62) 

£ (5 ' 2) =0 =*► p 5 2i = . (63) 

At this point we end with the same scalene parameters we work with in the k = 4 case 
and then let's follow the same steps as in the previous section 

E (4,3) =Q ^ p 432 = p 431 = o , (64) 
E^=0 p 421=P321 = . (65) 

Once all the scalene probabilities have been forced to zero, the demonstration is 
straightforward and follows the same way outlined in the previous sections for the k = 3, 4 
cases. 
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